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1.  INTRODUCTION 


The  concepts  of  metrics  and  distances  are  fundamental  in  problems 
of  statistical  inference  and  in  practical  applications  to  study  affini¬ 
ties  among  a  given  set  of  populations.  A  statistical  model  is  specified 
by  a  family  of  probability  distributions,  described  by  a  set  of  continu¬ 
ous  parameters  known  as  the  parameter  space.  This  model  possesses  some 
geometrical  properties  which  are  induced  by  the  local  information  struc¬ 
tures  of  the  distributions.  In  particular,  the  Fisher  information  matrix 
of  the  given  family  of  distributions  gives  rise  to  a  Riemannian  metric 
over  the  parameter  space,  whose  geodesic  distance,  known  as  the  Rao  dis¬ 
tance,  plays  a  major  role  in  multivariate  statistical  techniques.  For 
the  family  of  multivariate  normal  distributions  with  fixed  shape  but 
varying  locations,  this  distance  reduces  to  the  well-known  Mahalanobis 

distance.  -We^ refer^to  Burbea  and  Burbea  and  Rao, {3, 4],  and-the 

(' 

J 

refe<rences  therein*  for  more  details  on  these  concepts  and  their  deri¬ 
vations. 

An  Interesting  statistical  model  Is  provided  by  the  family  of 
elliptic  distributions  whose  density  functions  have  elliptical  contours 

and  which  Include  the  multivariate  normal  distributions  as  a  subfamily. 

-  V  «  i’ 

In  this  paper  we-stody-  the  Information  m^jkric  associated  with  an  ellip¬ 
tic  family  whose  shape  varies  linearly.  It  will  be  shown  that  this  met- 

\ 

ric  Is  essentially  the  Poincare' hyperbolic  metric  on  a  half-space,  and 
that  the  resulting  Rao  distance  Is  an  increasing  hyperbolic  function  of 
the  generalized  Mahalanobis  distance.  This  will  enable  us  to  construct 
new  statistical  tests  and  to  recover  the  recent  results  of  Mitchell  and 
Krzanowski  [6]  as  a  special  case  of  our  setting. 
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2.  INFORMATIVE  GEOMETRY  OF  ELLIPTIC  DISTRIBUTIONS 

We  begin  with  a  brief  description  of  the  general  informative  geom- 
etry  that  is  induced  by  a  parametric  family  PQ  -  { p( • | 0 ) :  9  e  0}  of 
distributions  for  a  random, variable  x,  possibly  vector-valued,  with  a 
sample  space  I,  Here  0  is  the  parameter  space,  a  manifold  embedded  in 
Fm,w1th  points  see  coordinated  by  e  3  [9^,  and  satisfying 

the  ordinary  conditions  of  regular  estimation.  The  elements  p ( - | 0 )  of 
PQ  are  probability  distribution  functions 

p(x|e)  *  dP(x|e)/du(x),  (x  e  I,  e  e  0) 
where  g  is  a  fixed  positive  o-flnite  additive  measure,  defined  on  a 
o-algebra  of  the  subsets  of  X.  In  particular, 

j  p ( • | 9 ) du  *  1,  (9  e  0). 

It  is  also  assumed  that  for  a  fixed  9  e  0,  the  m  functions 
*.  j  ( *  1 0 )  *  alog  p(  *  1 9  )/ae  j ,  (j  =  l,...,m) 

are  linearly  independent  and  are  in  L^(p(*|9)dg).  This,  by  the  Cauchy- 
Schwarz  inequality.  Implies  that  the  elements 

9Jk ( 9 )  =  (J,k  *  1 . m) 

of  the  information  matrix  G( 9 )  are  all  finite,  and  that  G(o)  is  (strictly) 
positive-definite.  It  also  implies  that  Uj(*|e)},  j  *  l,...,m,  forms  a 
basis  for  the  tangent  space  T  at  9  e  0,  and,  moreover  that 

ds2(9 )  =  de+G(9)d9 

is  a  Rlemannian  metric  on  0;  called  the  information  metric  of  £.e  family 
Pg.  This  metric  is  invariant  under  the  admissible  transformations  of 
the  parameters  as  well  as  of  the  random  variables,  and  the  differential 
geometry  associated  with  it  Is  called  informative  geometry.  The  latter 
includes  the  evaluations  of  curvatures  ,  geodesic  curves  and  geodesic 


distances.  The  geodesic  distance  S(e^,  9^)  between  the  points 
e^1'  and  of  0  is  known  as  the  Rao  distance  between  p(*|e^)  and 
p(.|e^)  of  PQ.  For  a  more  detailed  account,  we  refer  to  Burbea  [1] 
(see  also  Burbea  [2],  Burbea  and  Rao  [3,4],  Oiler  [8],  and  Oiler  and 
Cuadras  [9]).  We  also  note,  in  passing,  that  in  matrix-notation,  G(e) 
may  also  be  expressed  as 


6(e) 


Jq  log  p( *  1  a)  — log  p(-|e)J 


or  as 

G(e)  -  Eflu(‘|e)t(*|e)+} 
where  i(-|9)  *  [*j(*l®)»  •••» *m(*|9)3+- 

An  n-dimensional  random  variable  X  is  said  to  have  an  elliptic 
distribution  with  parameters  u  =  [v^  ...,un]+  and  z,  an  nxn  (strictly) 
positive-definite  matrix,  if  its  density  is  of  the  form 


P(x|u.  Z)  *  L^|J- 


F{(x  -  v)*l  ^  (  X  -  p )  } 


(2.1) 


where  F  Is  a  nonnegative  function  on  F+  »  (0,»)  satisfying 

f  rn/2_1F(r)dr  «  1. 

Jo 


(2.2) 


In  this  case  the  sample  space  I  Is  Fn  w^/th  du  =  dv,  the  usual  volume 
Lebesgue  measure  of  Fn.  The  parameter  space  9  Is  now  the  n(n  +  3)/2- 
dlmensional  manifold  Fn*P(n,  F),  where  P(n,F)  Is  the  set  of  all  n*n 
positive-definite  matrices  over  F. 

The  vector  u  and  the  matrix  r  for  the  point  (u,l)  In  o  may  be  ex¬ 
pressed  in  terms  of  E (X )  and  Cov(X),  provided  the  latter  exist.  In  fact, 
the  characteristic  function  $p(t)  ■  E(e't#A)  of  the  above  p(*|y,  l)  may 


iafcii 


be  expressed  as 


$F(t)  =  e,t‘pAp(t+Zt) 

fr 


(2.3) 


where 


AF(s)  =  r( n/2) J  rrt/2_1Ftr)Kn/2_1(rs)dr,  (s  e  F) 


with 


K  (s)  =  2VJ  (s1/2)/sv/2  =  l  - ^ - 

v  v  m»0  4mm!r(m+v+1) 

and  where  Jy  Is  the  ordinary  Bessel  function  of  order  v.  Formally, 


therefore, 


E(X)  -  t  &*F(t)|  * 
t* 


and 


E(XXt)  =  - 


►  t  "F 


nat'  1 t=o 

This  gives  E(X)  =  v  and  E(XX+)  =  uw+  +  cFE,  where 


km 

:F  *  -2a'(0)  =  l|^rn/2F(r)dr 


(2.4) 


'A 

I 


and  hence  Cov(X)  =  cFr.  In  particular,  E(X)  exists  if  and  only  If 
/"rn/2-1F(r)dr  <  -,  and  Cov(X)  exists  If  and  only  If  /grn,/2F( r)dr  <  <■>, 

1  r.  which  case  0  <  cF  <  -.  A  normal  distribution  Nn ( *  | u ,  r)  is  an  example 
of  an  elliptic  distribution  with 


F(s) 


1 


2n/2r(n/2) 


,-s/2 


Ac(s)  3  e 


■s/2 


Cr  =  1  • 


Other  basic  properties  of  elliptic  distributions  have  been  obtained  by 
Kelker  [5]  and  are  sumnarlzed  In  Mulrhead  [7,  pp. 32-40]. 
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We  now  turn  to  the  information  matrix  Gp(u,r)  of  the  elliptic 
distribution  (2.1).  In  this  paper,  however,  we  confine  our  attention 
to  a  submanifold  of  P(n,  F)  consisting  of  the  cone  C(Zq)  =  (a  ig:  a  >  0} 
where  Ig  is  a  fixed  element  of  P(n,  F).  The  resulting  parameter  space 
is  now  Fn*C(ig)  which  is  an  (n  +  1  )-dimens1onal  submanifold  of  the  full 
n(n + 3)/2-d1mens1onal  manifold  Fn*P(n,  F).  Note,  however,  that  the 
former  is  not  a  geodesic  submanifold,  with  respect  to  the  information 
metric  d9+Gp(e)de,  8  -  (u,z),  of  the  latter.  A  slight  generalization 

is  obtained  by  replacing  p  In  (2.1)  with  p  =  As  whece  6  =  [b1 . Bm]+ 

is  a  vector  in  Fm  and  A  is  a  fixed  n*m  matrix  of  rank  m  <_  n.  In  par¬ 
ticular,  A+A  Is  a  nonsingular  mxm  matrix,  and  the  density  in  (2.1)  Is 
of  the  form 

p(x|B.  o)  «  I^^-|z0r1/2a"nF{o'2(x-AB)+I*1(-  -  As)}  (2.5) 

where  F  Is  a  function  from  F+  into  F+,  satisfying  (2.2).  In  this  case, 

x  Is  In  the  sample  space  Fn  and  (6,c)  is  in  the  parameter  space 
Rm+1  .  pmxR+  wh1ch  1$  a  half.space  pm+1. 

In  the  setting  of  m  =  n,  A  =  I  (the  identity  matrix  of  Fn)  and 

a  s  1,  the  Informative  geometry  of  the  distribution  i-  (2.5),  with  6  in 

£ 

the  parameter  space  Fn,was  studied  by  Mitchell  and  .-zanowski  [6].  The 
analysis  in  this  paper  will  enable  us  t_  recover  the  ’-esults  in  the 
setting  of  [6]  as  a  special  case  of  our  more  general  setting. 

To  find  the  Information  matrix  G<D  >  =  g!0!  „  \  .  •)  of  p( - 1 s ,  o) 
in  (2.5),  we  shall  assume,  in  addition  to  (2.2'.  that  '  is  also  in 
C^F+J  with 

[  rn/2F(r){(XF)(r)}2dr  <  -  (2.6) 

JO 


-1 

> 


■J 


j 


s' 

i 

s 

,-s 

.-V 

J 

V 


"I 


,  / 
’v 
V 


I 

1 


and 


J  rn/2+1F(r){(IF)(r)}2dr  <  », 


(2.7) 


where  IF  =  F'/F  Is  the  logarithmic  derivative  of  F.  Then,  for 
P  3  p( •  1 8,  a),  6  *  g(b>0)  and  E  =  E^s  we  have 


G  = 


G11  G12 
G21  G22 


(2.8) 


where 


CM  *  E{—  log  p  —x  log  p), 
11  38  38t 


G12  *  G21  3  E{3?  J°9  P  &  109  P) 


and 


G22  =  E{£  log  p  -k  109  pK 

Later,  In  Section  4,  we  shall  shew  that  conditions  (2.2)  and  (2.6)- (2. 7) 
guarantee  the  finiteness  of  the  matrices  (1  <_  j ,  k  <  2)  and  the 
(strict)  positive-definiteness  of  the  information  matrix  G.  Moreover, 
we  shall  also  show  that,  in  fact 


where 


and 


.j  3  ao  2A^tg^A,  G -j g  =  G21  3  G22  =  ^ 


a  ■  J  j^rn/2F(r) { (IF) (r) }2dr 

09 

b  -  f  rn/2’^ {n  +  2r(lF)(r) )2F(r)dr. 
in 


(2.9) 


V 


8 


In  particular,  0  <  a,  b  <  ». 

2 

To  find  the  Information  metric  ds  of  p( * | e *  o),  we  consider  the 
orthogonal  diagonal Ization 

V0V+  =  A^A 

of  the  m-m  positive-definite  matrix  A^rj^A  =  (Eq1  +( ^2A) .  Here 
V  is  a  m*m  orthogonal  matrix  and  D  =  diag[x^,  xm]  with  x^  >  0 
(j  =  l,...,m).  Then  the  linear  change  of  parameters 

e  =  [0r  ....  em]+  =  /abrTD1/2V+B,  em+1  =  a 

constitutes  a  diffeomorphism  (8,c)t— =  (e,  em+1 )  of  the  parameter  space 
P.™+1  onto  Itself  with  the  Jacobian  (ab-1  )m/2  (x^  ...x^1^2  >  0-  The 
Jacobian-matrix  of  the  Inverse  of  this  transformation  is 


and  hence  the  information  matrix  G(s)  In  the  new  coordinates  e  = 
t0r  9m’  6m+l ^  is 

G(«)  ■  Aj  = 


where  I  +1  is  the  identity  matrix  of  R  .  (  The  information  metric  is 


0  +A  h  ^1  O 

ds^(e)  =  d0rG(9)d0  =  —  l  (dej  , 

Ci  j=1  J 


(2.10) 


Which  Is,  effectively,  the  Poincare  hyperbolic  metric  of  the  upper  half¬ 
space  F™+1  =  {[e^  ....  em+ilt  *  em+i  >  0}  (see*  for  example,  Wolf 

[10]).  It  follows  that  the  manifold  of  the  family  of  distributions  p( • | e)  in 
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(2.5),  e  e  IR™+\  is  isotropic  with  a  constant  negative  Riemannian 
curvature 

•c  =  -1/b. 

In  particular,  for  any  two  points  cn  this  hyperbolic  manifold,  there 
exists  one  and  only  one  geodesic  line  joining  the  two  points. 

The  equations  of  the  geodesics  of  the  above  information  metric, 
in  terms  of  its  arc* length  parameters,  are  found  to  be 

ek  *  ✓FC‘2B|<  tanh(-5- +  E)  +  ok,  (k  =  1 . m), 

Vi  *  C'1sech(^+  c)* 


where  e,  Bk  and  Dk  (k  =  l,...,m)  are  real  constants  of  integration. 


?  .2  1/2 


ctj,b; 


or  C  =  «,  in  which  case  ek  =  Dk  (k  =  l,...,m)  and  om+^  *  0.  Note  that 


since 


J/W*  *  9m*l  =  C'2- 

the  above  geodesics  are  semi-circles  of  the  upper  half-space  ]R™+^  ,  with 
center  (Dj,  ...,D  ,  0)  and  radius  C”\  and  are  orthogonal  to  the  hyper¬ 
surfaces  em+]  =  c.  U  >  0). 

The  geodesic  distance  or  the  Rao  distance  between  two  points 
9^  a  (e(1),  e^j)  and  *  (e^,  e^j)  of  IR™+1  is  then 


p  12  *  ^  1o9  TT7 —  a  2vF  tanh-f(A  ) 


(2.11) 


>12 


|e(1)-e(2)||2  ♦  ble^j-e^j)2 


i  u 


V  V 


Thus,  using  the  old  coordinates  (b.o)  of  F1 


m+1 


this  Rao  distance  p 


mm 

a*8(1)  "  e(2) )+A+rolA^6( 1 )  ‘  6(2)*  +  b ( 0 1  ”  °2 ) 

|i|  *12  * 

8{ 1 )  ”  8(2) ^  ^  ^0  ^®(1)  "  ®(2)^  +  b(oi  +  o-) 

1/2 


( 
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3.  MAHALANOBIS  DISTANCE 

4 

t 

If  o  In  the  distributions  (2.5)  Is  fixed,  say  o  *  eg  >  0,  then  the 
parameter  space  of  the  distributions  Is  restricted  to  lRm.  In  this  case 
the  Information  metric  In  (2.10)  reduces  to  the  euclidean  metric  on  Rm 


and  thus  the  resulting  Rao  distance  p^  between  p(*|e^v,  oQ)  and 
p(*|S(2)»  ctq)»  the  man^old  Rm*{cg},  Is 

t  t  -1  M/2 

5(1)  ”0(2))  A  Z0  A(B(1)  "0(2))  ‘ 


*12  *  «O1^{(0 


(3.1) 


Since,  however,  Rm*{og}  Is  clearly  not  a  geodesic  submanifold  with  re¬ 
spect  to  the  nonreduced  metric  ds^(e),  of  R1^  ■  Rm*R+  p^  must  exceed 
the  nonreduced  Rao  distance  0]2  between  p(*|6(1j,  aQ)  and  P( - lfl(2) *  a0)* 
Ir  the  general  case  that  c  Is  not  fixed,  we  Introduce  a  modifica¬ 


tion  of  p^2  In  the  form 


^12  *  ^°i°2^  ^  *^1^6(1 )- 6(2) )  A  Ig  A(b^j-6(2))|  ,  (3.2) 

which  we  call  the  Mahalanobis  generalized-distance  between  p(*|6^j,  o^) 
and  P(*l0(2)*  This  reduces  to  p^  when  *  °2  =  °0  an<* 

Is  directly  related  to  the  classical  Mahalanobis  distance  M^  between 
P(* l0( 1 ) *  °0^  an<*  p^*i0(2)*  °0^’  prov*ded  that  Cov(X)  of  the  distribu¬ 
tion  p(*  ja,  og)  In  (2.5)  exists.  That  Is,  besides  (2.2)  and  (2.6)-(2.7), 
we  must  also  assume  that  the  quantity  cF,  defined  In  (2.4),  satisfies 
0  >  cF  <  -.  In  this  case,  Cov(X)  ■  CpOglg  and  p^  *  ZaCpM^.  The  re¬ 
lationship  between  the  Mahalanobis  generalized-distance  d^  and  the  Rao 


Unclassified 


lllkM  Otfl  IMMO 
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distance  «,12  can  be  read  off  from  (2.11)-(2.12)  and  (3.2).  This,  after 
some  algebraic  manipulations,  gives 


p,,  *  2/TT  sinh'l  — 


2  2 
d^  +  b(c^  -  a2)  /°}°2 


|l/2 


'12  -  2*5 

In  particular,  is  an  increasing  function  of  d,,,  and 


2  2 
p  1 2  i  +  b^°1  ’°2^  /°i°2^ 


12’ 

1/2 


We  therefore  conclude  that  the  statistical  tests  based  on  eithe.-  or 
on  d12  are  completely  equivalent  when  /c^/o^  -  -  const.  In  particu¬ 

lar,  this  Is  so  when  and  o2  are  fixed.  Moreover,  when  Oj  *  o2  *  oQ, 
d12  reduces  to  and  we  obtain  the  symmetric  relationships 

p  1 2  =  2/F  slnh'^ (p^/2^) 
and 

Pj2  "  2^  sinh(p^/2i^) ,  (cj  -  o2  -  oQ). 


Especially,  p^  is  an  Increasing  function  of  p^  and,  of  course, 

p12  -  p12"  Moreover*  3  P]2  when  pi2  <4  2*5. 

When  Cov(X)  of  p ( - | s ,  Og)  exists,  the  reduced  Rao  distance  p,2  in 

(3.1)  was  also  discussed  in  Mitchell  a^b  Krzartowski  [6]  in  the  special 
setting  of  m  =  n,  A  *  I  and  oQ  *  1.  The  discussion  in  [6],  however, 
does  not  contain  the  above  relationships  between  p^  and  the  fuller  Rao 

12- 


distance  p 
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4.  EVALUATIONS  OF  INTEGRALS 

4 

This  section  is  devoted  to  the  evaluations  of  the  integrals  appear¬ 
ing  in  this  paper  that  are  associated  with  the  elliptic  distribution 
(2.1)  and  its  information  matrix  G  in  (2.8).  It  may  therefore  be  re¬ 
garded  as  an  appendix  to  this  paper. 


To  evaluate  an  integral  of  the  form  /  fdv,  we  use  polar  coordin- 

nr 


ates 


|  f (x)dv(x)  =  |  rn_1(f  f(rx)do(x)Jdr 


(4.1) 


where  dv  is  the  volume  Lebesgue  measure  of  lRn,  Sn  »  {x  e  lRn:  ||x||  *  U 

is  the  unit  sphere  of  !Rn,  and  do  is  its  surface  measure. 

For  x  =  [X] . xn]+  e  Rn  and  a  =  [c^ ,  . . . ,  an]+  e  z" ,  we  use 

the  multinomial  notation  of  x°  =  x?1  ...  xan  and  lal  «  a,  +  ...  +  a„. 

1  n  11  I  n 

We  also  define  a  function  5:  Fn— Mo.l)  by  letting  <s(x)  =  1  if  x  e  2^ 
and  «(x)  =  0  if  x  e  Fn\  zj. 

LEMMA  4.1.  Let  a  -  ,  .  ,.,a  e  2^.  Then 

xado(x)  -  5  (a/2 )  2  n  r((a  ,  ♦  l)/z)/r((n*  |a|)/Z). 


In  particular, 


c(Sn)  *  |  do  *  2in/2/r(n/2), 


Proof .  Using  (4.1),  we  find  that 

.2  f  *  iiy  2/ 


f  dv(.)  .  f  r»‘l«l-Vr(fs  .’do(«))dr 


Js„ 
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If  for  some  1  £  j  ±  n,  Oj  is  odd,  then  the  above  product  vanishes. 
Otherwise, 


and  the  lemma  follows. 


This  lemma,  together  with  (4.1),  will  enable  us  to  prove  that 

p ( • | w ,  E)  In  (2.1)  Is  a  probability  distribution,  provided  (2.2)  Is 

-1/2 

satisfied.  Indeed,  letting  y  ■  I  '  (x-y),  we  have 
f  p(x|w,  E)dv(x)  -  F(||y||2)dv(y) 

V  w  V 


*  2j  rn”^F(r2)dr 
0 


•  j  rn/2’1F(r)dr  -  1. 
0 

Similarly,  to  prove  (2.3),  we  observe  that 


E(e1t,(X'u))-  f  e1t,(x"u)p(x|w.  z)dv(x) 

Fn 

e1s,yF(||y||2)dv(y). 

*  *" 

But,  using  (4.1)  and  Lemma  4.1  again,  we  obtain  the  well-known  formula, 

m 

f  efs,yF(j|y||2)dv(y)  -  ( 2,r ) n/2 1|  s  ||_  ( n"2 } /2  f  rfl/2F(rZ)Jn/2.1  ( ||  s  ||r)dr, 
Fn  0 

and  so 

E(eU*(X'u))  «  2r(n/2)|  rn " 1  F( r2 ) <n/2_ , ( r2 1| s || 2 ) dr 

0 

* 

-  r(n/2)J  rn/2-1F(r)Kn/2.1(r||s|i2)dr 
0 

•  af( ||s II2)  »  Ap( ttrt) , 

and  (2.3)  follows. 

We  now  consider  the  distribution  p ( * | s •  a)  In  (2.5),  under  the 
assumptions  (2.2)  and  (2.6)-(2.7).  To  evaluate  the  Information  matrix  G 
In  (2.8),  we  calculate  the  matrices  Gj^  (1  <_  j,  k  <_  2)  with  the  aim  of 
orovlng  (2.9).  /<*  let  Z  ■  o-1r’1/2(x  -  As) ,  to  find 

G11  "  72  8+E{(XF)2(||Z||2)Z+Z}B, 

612  "  G21  ’  7  BtE{(XF)(||Z||2)(n^2!|Z||2(XF)(||Z||2))Z} 

G22  "  ^E{(n>2|!Z||2(XF)(||Z||2))2}, 


and 
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-1/2 

where  B  =  ZQ  'A. 
of  the  n*n  matrix 


We  use  (4.1)  and  Lerma  4.1  tn  compute  the  elements 
E{(XF)2(  || Z  ||  ^ ) Z+Z } .  The  ( 1 3 j )-element  Is  then 


->  2i 


1j 


„(n-l)/2r(3/2)  rtn/2)  [' 
r(n/i  ♦  1 )  ~J]T 

n 


rn+1(rF)2(r2)F(r2)dr 


“  61j  n  j  r"/2F(r){(XF)(r)>2 dr  *  fi^a/4, 
0 


and  thus  G^ 


«  ao”2A+t"1A  as  In  (2.9). 


Similarly, 

E{(n>2||Z||2(XF)(||Z||2))2} 


{j^J  rn-1(n>2r2(XF)(r2))2F(r2)( 


2\N  2. 


(do)dr 


•  |  rn/,2“^  (n  +  2r  (XF)(r)  }2dr  »  b, 
0 


anc  o  G„  *  bo'*-  as  In  (2.9).  > 

22  ^ 

Finally,  the  n*l  expectlon-matrlx  appearing  In  the  mxl  mat-lx  G^ 
Is  finite  by  virtue  of  the  Cauchy-Schwarz  Inequality  and  by  the  finite 
ness  of  G^  and  G^.  It  follows  from  (4.1)  and  Lemma  4.1  that 
G12  ■  G21  -  0  as  In  (2.9). 
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